Neural Random-Access Machines
نویسندگان
چکیده
In this paper, we propose and investigate a new neural network architecture called Neural Random Access Machine. It can manipulate and dereference pointers to an external variable-size random-access memory. The model is trained from pure input-output examples using backpropagation. We evaluate the new model on a number of simple algorithmic tasks whose solutions require pointer manipulation and dereferencing. Our results show that the proposed model can learn to solve algorithmic tasks of such type and is capable of operating on simple data structures like linked-lists and binary trees. For easier tasks, the learned solutions generalize to sequences of arbitrary length. Moreover, memory access during inference can be done in a constant time under some assumptions.
منابع مشابه
Lie-Access Neural Turing Machines
External neural memory structures have recently become a popular tool for algorithmic deep learning (Graves et al., 2014; Weston et al., 2014). These models generally utilize differentiable versions of traditional discrete memory-access structures (random access, stacks, tapes) to provide the storage necessary for computational tasks. In this work, we argue that these neural memory systems lack...
متن کاملTHE "CAM-BRAIN" PROJECT The Evolutionary Engineering of a Billion Neuron Artificial Brain which Grows/Evolves at Electronic Speeds in a Cellular Automata Machine Part 1 : Fundamentals
This 2 part paper reports on the "CAM-Brain Project", which is an 8 year research project, beginning in 1993, at ATR labs in Kyoto, Japan, which intends to build/grow/evolve an artificial brain containing billions of artificial neurons. The essential idea behind CAM-Brain is to use cellular automata [Codd 1968] based neural networks which grow/evolve at electronic speeds inside cellular automat...
متن کاملPerformance evaluation of chain saw machines for dimensional stones using feasibility of neural network models
Prediction of the production rate of the cutting dimensional stone process is crucial, especially when chain saw machines are used. The cutting dimensional rock process is generally a complex issue with numerous effective factors including variable and unreliable conditions of the rocks and cutting machines. The Group Method of Data Handling (GMDH) type of neural network and Radial Basis Functi...
متن کاملThe Linear Time Hierarchy Theorems for Abstract State Machines and RAMs
We prove the Linear Time Hierarchy Theorems for random access machines and Gurevich abstract state machines. One long-term goal of this line or research is to prove lower bounds for natural linear time problems.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- ERCIM News
دوره 2016 شماره
صفحات -
تاریخ انتشار 2016